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SPECIFICATION 

TRANSMITTING APPARATUS, IMAGE PROCESSING SYSTEM, IMAGE 
PROCESSING METHOD, PROGRAM, AND STORAGE MEDIUM 

TECHNICAL FIELD 

The present invention relates to a transmitting 
apparatus, an image processing system, an image processing 
method, a program, and a storage medium of compressing an 
image generated by an image generating apparatus. 

BACKGROUND ART 

Conventionally, there have been proposed image 
processing methods. of transmitting an image by dynamically 
changing a compressing method depending on image 
information or a condition of communication paths. The 
known methods include, for example, a method described in 
Japanese Unexamined Patent Publication (Kokai) No. 
HlO-145796, pages 9 and 10 (first method). The entire 
disclosure of Japanese Unexamined Patent Publication 
(Kokai) No. HlO-145796 is incorporated herein by reference 
in its entirety. 

First, the first method will be explained. Fig. 11 
shows a coding apparatus 101 employing the first method. 
The coding apparatus 101 includes switches SWl and SW2 of 
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switching compressing methods, a predictive coder 102, a 
variable length coder 103, and an MPEG coder 104. 

According to this method, a movable region is first 
detected within an image read from a memory. Next, 
performing histogram processing to the detected region, 
it is determined whether or not the image is similar to 
a natural image, and based on the determination result, 
the switches SWl and SW2 are then switched. As a result 
of this, the dynamic image can be MPEG-coded by the MPEG 
coder 104 , while the other types of images may be compressed 
by the predictive coder 102 and the variable length coder 
103. 

Japanese Unexamined Patent Publication (Kokai) No. 
2001-36655 describes the invention of calculating data 
transmission speed on a network when image data is 
transmitted via the network to downsize the image data to 
be transmitted based on the calculated data transmission 
speed (second method) . The entire disclosure of Japanese 
Unexamined Patent Publication (Kokai) No. 2001-36655 is 
incorporated herein by reference in its entirety. 
According to this invention, it is described the method 
of resizing the image data or varying a compression ratio 
so that the transmission time may be kept constant by 
reducing a data amount . 

In the case of the first method, since histogram is 
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used to determine whether or not the detected moving region 
is similar to the natural image, it takes a certain amount 
of time to determine the natural image region, and in 
addition to that, the determination is frequently mistaken, 
resulting in difficulty in achieving high-speed. 
Meanwhile, in the case of the second method, since the image 
compression ratio is changed according to the transmission 
speed, high-speed transmission has been able to be achieved, 
but the method has been disadvantageous since image 
distortion has often occurred due to the change in the 
compression ratio regardless of image characteristics. 

As a result, there still remain problems that to 
achieve the high-speed transmission is difficult, and the 
image distortion is likely to occur even if the high speed 
transmission is established. 

DISCLOSURE OF THE INVENTION 

In view of the foregoing problems, the present 
invention aims at providing a transmitting apparatus, an 
image processing system, an image processing method, a 
program, and a storage medium of compressing an image 
smaller in volume at high speed while preventing the image 
from degradation. 

The first aspect of the present invention is a 
transmitting apparatus comprising: 
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detection means of detecting whether an image to be 
processed is changed exceeding a predetermined criterion; 

compression means of compressing said image so that 
a compression degree may be higher when a detection result 
by said change detection means indicates that said image 
is changed exceeding said predetermined criterion, and 
when said detection result by said change detection means 
indicates that said image is changed not exceeding said 
predetermined criterion, of compressing said image so that 
the compression degree may become lower; and 

output means of outputting said compressed image* 

The second aspect of the present invention is the 
transmitting apparatus according to the first aspect of 
the present invention, wherein 

said image to be processed is temporarily stored in 
an image memory, and 

said detection means periodically reads said image 
from said image memory to compare said before and after 
images, and detects whether said image to be processed is 
changed exceeding said predetermined criterion. 

The third aspect of the present invention is the 
transmitting apparatus according to the first aspect of 
the present invention, wherein said predetermined 
criterion is the number of pixels changed between said 
before image and said after image. 
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The fourth aspect of the present invention is the 
transmitting apparatus according to the first aspect of 
the present invention, wherein said predetermined 
criterion is a level by which to determine that said image 
has not been changed, if said region where the image is 
changed is smaller than a predetermined size in area, and 
is in the same position as the previously detected region 
where the image was changed. 

The fifth aspect of the present invention is the 
transmitting apparatus according to the first aspect of 
the present invention, wherein said compression means 
compresses said image by changing the compression ratio 
of said image according to a degree of change in said image 
detected by said change detection means. 

The sixth aspect of the present invention is the 
transmitting apparatus according to the first aspect of 
the present invention, wherein 

while said image is not changed, except for every 
predetermined period, said compression means does not 
compress said image and said output means does not 'output 
said image, and 

said compression means compresses said image at every 
predetermined period and said output means outputs said 
image at every predetermined period. 

The seventh aspect of the present invention is the 
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transmitting apparatus according to the sixth aspect of 
the present invention, wherein said compression means does 
not compress said image when said predetermined period is 
repeated for a predetermined number of times or more, and 
said output means does not output said image when said 
predetermined period is repeated for said predetermined 
number of times or more. 

The eighth aspect of the present invention is the 
transmitting apparatus according to the seventh aspect of 
the present invention, wherein when compressing said image 
at said every predetermined period, said compression means 
compresses said image to be compressed later at a 
compression ratio lower than a compression ratio of said 
image compressed earlier. 

The ninth aspect of the present invention is the 
transmitting apparatus according to the first aspect of 
the present invention, wherein 

said image to be processed is that generated by an 
image signal generating apparatus, and 

said image signal generating apparatus is a personal 
computer . 

The tenth aspect of the present invention is the 
transmitting apparatus according to the first aspect of 
the present invention, wherein 

for each of a plurality of blocks into which said 
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image that is generated by said image signal generating 
apparatus is zone-devided, said change detection means 
detects whether said image to be processed is changed 
exceeding said predetermined criterion, and 

for every said block in which it has been detected 
whether said image to be processed is changed exceeding 
said predetermined criterion, said compression means 
compresses said image so that the compression degree may 
become higher when said detection result by said change 
detection means indicates that said image is changed 
exceeding said predetermined criterion, and compresses 
said image so that the compression degree may become lower 
when said detection result by said change detection means 
indicates that said image is changed not exceeding said 
predetermined criterion . 

The eleventh aspect of the present invention is an 
image processing system comprising: 

an image signal generating apparatus of generating 
an image; 

a transmitting apparatus including detection means 
of detecting whether said image to be processed that is 
generated by said image signal generating apparatus is 
changed exceeding a predetermined criterion, compression 
means of compressing said image so that a compression 
degree may be higher when said detection result by said 



change detection means indicates that said image is changed 
exceeding said predetermined criterion, and when said 
detection result by said change detection means indicates 
that said image is changed not exceeding said predetermined 
criterion, of compressing said image so that the 
compression degree may become lower, and transmission 
means of transmitting said compressed image; and 

a receiving apparatus including expanding means of 
expanding said transmitted image utilizing information 
•regarding compression of said image by said compression 
means, and output means of outputting said expanded image. 

The twelfth aspect of the present invention is the 
image display system according to the eleventh aspect of 
the present invention, wherein 

said transmitting apparatus also serves as said image 
signal generating apparatus, and 

said transmitting apparatus and said image signal 
generating apparatus are a personal computer. 

The thirteenth aspect of the present invention is the 
image display system according to the eleventh aspect of 
the present invention, wherein said receiving apparatus- 
is a projector. 

The fourteenth aspect of the present invention is an 
image processing method comprising: 

detection step of detecting whether an image to be 
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processed is changed exceeding a predetermined criterion; 

compression step of compressing said image so that 
a compression degree may become higher when a detection 
result by said change detection step indicates that said 
image is changed exceeding said predetermined criterion, 
and when said detection result by said change detection 
means indicates that said image is changed not exceeding 
said predetermined criterion, compressing said image so 
that compression degree may become lower; and 

output step of outputting said compressed image. 

The fifteenth aspect of the present invention is a 
program of causing a computer to function, in the 
transmitting apparatus according to the first aspect of 
the present invention, as: 

detection means of detecting whether an image to be 
processed is changed exceeding a predetermined criterion; 

compression means of compressing said image so that 
a compression degree may become higher when a detection 
result by said change detection means indicates that said 
image is changed exceeding said predetermined criterion, 
and when said detection result by said change detection 
means indicates that said image is changed not exceeding 
said predetermined criterion, of compressing said image 
so that compression degree may become lower; and 

output means of outputting said compressed image. 
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The sixteenth aspect of the present invention is a 
recording medium storing the program according to the 
fifteenth aspect of the present invention, wherein said 
recording medium is computer processable. 

The seventeenth aspect of the present invention is 
a transmitting apparatus including 

detection means of detecting whether an image to be 
processed is changed exceeding a predetermined criterion, 

compression means of compressing said image so that 
the compression degree of a predetermined rectangular 
region including the changed region may become higher when 
a detected result by said change detection means indicates 
that said image is changed exceeding said predetermined 
criterion, and when the detected result by said change 
detection means indicates that said image is not changed 
exceeding said predetermined criterion, of compressing 
said image so that a compression degree of a rectangular 
region including all of said rectangular regions among 
former images than said image may become lower, 

output means of outputting said image in the 
predetermined rectangular region including the changed 
region when the detected result by said change detection 
means indicates that said image is changed exceeding said 
predetermined criterion, and when the detected result by. 
said change detection means indicates that said image is 



not changed exceeding said predetermined criterion, of 
outputting said image in said rectangular region including 
all of said rectangular regions. 

The eighteenth aspect of the present invention is a 
transmitting apparatus according to the seventeenth 
aspect of the present invention, wherein 

said image to be processed is temporarily stored in 
an image memory, and 

said detection means periodically reads said image 
from said image memory to compare said before and after 
images, and detects whether said image to be processed is 
changed exceeding said predetermined criterion. 

The nineteenth aspect of the present invention is a 
transmitting apparatus according to the seventeenth 
aspect of the present invention, wherein said 
predetermined criterion is the number of pixels changed 
between said before and after images. 

The twentieth aspect of the present invention is a 
transmitting apparatus according to the seventeenth 
aspect of the present invention, wherein said 
predetermined criterion is used to determine that said 
image is not changed, if the region where said image is 
changed is smaller than a predetermined size in area, and 
is in the same position as the previously detected region 
where said image is changed. 
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The twenty-first aspect of the present' invention is 
the transmitting apparatus according to the seventeenth 
aspect of the present invention, wherein said compression 
means compresses said image by changing compression ratio 
of said image according to a degree of change in said image 
detected by said change detection means. 

The twenty-second aspect of the present invention is 
the transmitting apparatus according to the seventeenth 
aspect of the present invention, wherein 

during said image is not changed, except for every 
predetermined period, said compression means does not 
compress said image and said output means does not output 
said image, and 

said compression means compresses said image at every 
predetermined period and said output means outputs said 
image at said every predetermined period. 

The twenty-third aspect of the present invention is 
the transmitting apparatus according to the twenty-second 
aspect of the present invention, wherein when said 
predetermined period is repeated for the predetermined 
number of times or more, said compression means does not 
compress said image, and when said predetermined period 
is repeated for said predetermined number of times or more, 
said output means does not output said image. 

The twenty-fourth aspect of the present invention is 
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the transmitting apparatus according to the twenty-third 
aspect of the present invention, wherein when compressing 
said image at said every predetermined period, said 
compression means compresses said image to be compressed 
later at a compression ratio lower than a compression ratio 
of said image to be compressed earlier. 

The twenty-fifth aspect of the present invention is 
the transmitting apparatus according to the seventeenth 
aspect of the present invention, wherein 

said image to be processed is one that is generated 
by an image signal generating apparatus, and 

said image signal generating apparatus is a personal 
computer . 

The twenty-sixth aspect of the present invention is 
the transmitting apparatus according to the seventeenth 
aspect of the present invention, wherein 

for each of a plurality of blocks into which said 
image that is generated by said image signal generating 
apparatus is zone-divided, said change detection means 
detects whether said image to be processed is changed 
exceeding said predetermined criterion, and 

for said every block in which said image to be 
processed is detected to be changed exceeding said 
predetermined criterion, said compression means 
compresses said image so that the compression degree of 
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the predetermined rectangular region including said 
changed region may become higher, and compresses said image 
so that the compression degree of a region other than said 
rectangular region may become lower. 

The twenty-seventh aspect of the present invention 
is an image processing system including, 

an image signal generating apparatus of generating 
an image, 

a transmitting apparatus including detection means 
of detecting whether the image to be processed, which is 
generated by said image signal generating apparatus, is 
changed exceeding a predetermined criterion, compression 
means of compressing said image so that a compression 
degree of the predetermined rectangular region including 
said changed region may become higher when the detected 
result by said change detection means indicates that said 
image is changed exceeding said predetermined criterion, 
and when the detected result by said change detection means 
indicates that said image is not changed exceeding said 
predetermined criterion, of compressing the image so that 
a compression degree of a rectangular region including all 
of the rectangular regions among former images than said 
image may become lower, and output means of outputting said 
image in the predetermined rectangular region including 
said changed region when the detected result by said change 
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detection means indicates that said image is changed 
exceeding said predetermined criterion, and when the 
detected result by said change detection means indicates 
that said image is not changed exceeding said predetermined 
criterion, of outputting said image in said rectangular 
region including all of said rectangular regions, 

a receiving apparatus including expanding means of 
expanding said transmitted image utilizing information 
regarding compression of said image by said compression 
means, and output means of outputting said expanded image. 

The twenty-eighth aspect of the present invention is 
the image display system according to the twenty-seventh 
aspect of the present invention, wherein 

said transmitting apparatus also serves as said image 
signal generating apparatus, and 

said transmitting apparatus and said image signal 
generating apparatus are a personal computer. 

The twenty-ninth aspect of the present invention is 
the image display system according to the twenty-seventh 
aspect of the present invention, wherein said receiving 
apparatus is a projector. 

The thirtieth aspect of the present invention is an 
image processing method including, 

a detection step of detecting whether an image to be 
processed is changed exceeding a predetermined criterion. 



- 15 - 



a compression step of compressing said image so that 
a compression degree of the predetermined rectangular 
region including said changed region may become higher, 
when the detected result by said change detection means 
indicates that said image is changed exceeding said 
predetermined criterion, and when the detected result by 
said change detection means indicates that said image is 
not changed exceeding said predetermined criterion, 
compressing said image so that a compression degree of a 
rectangular region including all of said rectangular 
regions among former images than said image may become 
lower, and 

an output step of outputting said image in the 
predetermined rectangular region including said changed 
region when the detected result by said change detection 
means indicates that said image is changed exceeding said 
predetermined criterion, and when the detected result by 
said change detection means indicates that said image is 
not changed exceeding said predetermined criterion, 
outputting said image in said rectangular region including 
all of said rectangular regions . 

The thirty-first aspect of the present invention is 
a program of causing the computer to function, in the 
transmitting apparatus according to the seventeenth 
aspect of the present invention, as: 
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detection means of detecting whether an image to be 
processed is changed exceeding a predetermined criterion, 

compression means of compressing said image so that 
a compression degree of the predetermined rectangular 
region including said changed region may become higher, 
when the detected result by said change detection means 
indicates that said image is changed exceeding said 
predetermined criterion, and when the detected result by 
said change detection means indicates that said image is 
not changed exceeding said predetermined criterion, of 
compressing the image so that a compression degree of a 
rectangular region including all of said rectangular 
regions among former images than said image may become 
lower, 

output means of outputting said image in the 
predetermined rectangular region including said changed 
region when the detected result by said change detection 
means indicates that said image is changed exceeding said 
predetermined criterion, and when the detected result by 
said change detection means indicates that said image is 
not changed exceeding said predetermined criterion, 
outputting said image in said rectangular region including 
all of said rectangular regions. 

The thirty-second aspect of the present invention is 
a recording medium of storing the program according to the 
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thirty-first aspect of the present invention, wherein the 
recording medium is computer processable. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a flowchart illustrating an operation of 

an image processing method according to a first embodiment 

of the present invention; 

Fig. 2 is a block diagram illustrating an image 

processing device performing the first embodiment of the 

present inventions- 
Fig. 3 is a schematic diagram illustrating an 

operation according to the first embodiment of the present 

invention; 

Fig. 4 is a schematic diagram illustrating an 
operation according to the first embodiment of the present 
invention; 

Fig. 5 is a flowchart illustrating an operation of 
an image processing method according to a second embodiment 
of the present invention; 

Fig. 6 is a schematic diagram illustrating an 
operation according to the second embodiment of the present 
invention; 

Fig. 7 is a block diagram illustrating a third 
embodiment of the present invention; 

Fig. 8 is a block diagram illustrating an operation 
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according to the third embodiment of the present invention; 
Fig. 9 is a flowchart illustrating another operation 

according to the first embodiment of the present inventions- 
Fig. 10 is a schematic diagram illustrating another 

operation according to the first embodiment of the present 

invention; and 

Fig. 11 is a block diagram illustrating a 

configuration of a conventional image processing device. 

Description of the Reference Numerals 

11: CPU 

12: bus line 

13: memory 

14: display 

15: input section 

16: graphic adapter 

21: whole PC screen 

22: changed region 

31: projector 

32: screen 

33: personal computer (PC) 

34: wireless LAN transceiver 

41: image loading means 

42: updated region calculating means 

43: compressing method selecting means 

44: updating region retrieving means 
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time management means 
input device 
image compression means 
image information transmitting means 
compressed image transmitting means 
image information receiving means 
compressed image receiving means 
image expanding means 
previous screen updating means 
display means 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinbelow, embodiments according to the present 

invention will be explained with reference to the drawings . 
(First embodiment) 

An image processing method according to a first 
embodiment according to the present invention will be 
explained. In this embodiment, images displayed on a 
screen of a personal computer (hereinbelow, referred to 
as PC) are intended to be consecutively loaded and 
compressed. Fig. 2 is a block diagram illustrating an 
image processing device of the present embodiment, while 
Fig. 3 schematically illustrates a PC screen. 

In Fig. 2, a CPU 11 is connected to a bus line 12. 
A memory 13 and a display 14, as well as an input section 
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15 and a graphic adapter 16, are connected to the bus line 
12 to constitute the image processing device. 

Next, an image processing method of the present 
embodiment will be explained in detail with reference to 
a flowchart shown in Fig. 1. At Step SI, contents of the 
whole PC screen are loaded into the memory in the PC. The 
contents of the whole PC screen are temporarily stored in 
an image memory (frame buffer or GRAM) and the image is 
periodically read therefrom. At Step S2, the loaded 
contents of the whole screen are compared with the 
previously loaded contents and coordinates of changing 
points are calculated to thereby determine a changed region 
in the screen , 

Fig. 3 is a diagram of explaining an example of a 
calculating method of the changed region . Here, reference 
.numeral 21 represents the whole screen of the PC. A mark 
"x" shown in Fig. 3 represents a pixel that has a change 
between the currently loaded screen and the previously 
loaded screen. 

The changed region is obtained by calculating a 
minimum rectangle including all of the pixels having a 
change in the screen. Fig. 3 illustrates an example of 
a changed region 22 obtained by the calculation. At the 
time of an initial loading, however, the whole screen is 
considered to be the changed region because there exists 
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no previously loaded screen. 

If there is the changed region 22 calculated at Step 
S2, which means that the PC screen is changed, the process 
branches at Step S3 to Step S4 . If there is no changing 
point and thus no changed region, it is determined at Step 
S3 that the PC screen is not changed and the process then 
branches to Step S6. 

When the PC screen is changed and the process branches 
to Step S4, the compression degree is set to high in a 
compressing method using the high compression ratio, for 
example JPEG compression, to compress the changed region 
22 calculated at Step S2 . In other words, when the PC 
screen is changed, distortion in the screen is unlikely 
to be noticeable compared with the case where the screen 
is static, so that the compressing method with the high 
compression ratio is applied thereto. The number of 
recompression times n is then set to 0 at Step S5, a 
compressed image is written in a transmission memory at 
Step S12, and the process returns to Step SI. The number 
of recompression times n represents the number of times 
of compression performed at Step 9 or Step 10 after being 
determined at Step 3 that there is no changed region. 

When the PC screen is not changed and the process 
branches to Step S6, it is determined at Step S6 whether 
the number of recompression times n is 2 or more, and if 
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n is 2 or more, it is determined that it is not necessary 
to recompress the image and the process then returns to 
Step SI . In other words, when the image is compressed twice 
or more at Step 9 or Step 10 after the change of the PC 
screen is not detected, the transmission memory stores the 
image compressed without distortion. In this case, it is 
not required to rewrite the image in the transmission 
memory, which is identical to that written in the 
transmission memory, by compressing it again without 
distortion. Accordingly, it is determined that it is not 
necessary to recompress the image and the process then 
returns to Step SI. If n is determined to be 0 or 1 at 
Step S6, the process proceeds to Step S7 . 

At Step S7, where the time passage after the 
compression is performed at Step S4 or Step S9 is monitored, 
the process proceeds to Step S8 when a predetermined period 
of time, for example one second, passes. When the 
predetermined time has not passed, it is determined that 
the screen is not static and the process then returns to 
Step SI. In other words, when it is determined at Step 
S7 that the predetermined time has not passed since the 
compression is processed, the recompression will not be 
performed. Since the compression performed at Step S9 or 
Step SIO utilizes the compressing method with small or no 
distortion, a data size of the compressed image obtained 
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therefrom becomes larger than that obtained by the 
compression at the high compression ratio performed at Step 
S4 . Transmission of the compressed image with a larger 
data size takes more time, so that the recompression will 
not be allowed until a predetermined period of time passes 
after the previous compression* 

At Step S8, it is changed the number of recompression 
times, and if it is n=0, the compression with small 
distortion, for example JPEG compression with low 
compression ratio, will be performed at Step S9. If n=l, 
the compression with no distortion, for example PNG method 
compression, will be performed at Step SIO. In other words, 
when the PC screen is not changed, distortion in the screen 
is likely to be noticeable compared with the case where 
the PC screen is changed, so that the compressing method 
with small or no distortion will be applied. Moreover, 
by the operations at Steps S8, S9, and SIO, the image to 
be compressed later is compressed at the lower compression 
ratio compared with the previously-compressed image. A 
method of calculating the region to be compressed at Step 
S9 or Step SIO will be hereinbelow described. 

After performing the compression at Step S9 or Step 
SIO, n is incremented by 1 at Step Sll, the compressed image 
is written in the transmission memory at Step S12, and then 
the process returns to Step SI of repeating the process. 
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As will be understood, the image is compressed twice 
at the maximum after it is determined that there is no 
changed region, namely the PC screen is not changed. In 
other words, when the PC screen still remains static after 
the image is compressed twice and written in the 
transmission memory, a process is not performed to compress 
the image for the third time and write the image in the 
transmission memory. As described above, the image is 
neither compressed nor outputted while the PC screen is 
not changed. The image is compressed and outputted at 
every predetermined period- When the predetermined 
period is repeated for the predetermined number of times 
or more, the image is neither compressed nor outputted. 

Next, the method of calculating the region to be 
compressed at Step S9 and Step SIO will be described. Fig. 
4 is a diagram of describing the method of calculating the 
region to be compressed at Step S9 and Step. SIO. Here, 
an example is shown in a case when the changed region in 
the screen is generated three times at Step 32 after the 
compression is performed at Step S9 or Step SIO . The region 
22 shown in Fig. 4 is the changed region calculated at Step 
S2 after the compression at Step S9 or Step 810, while a 
region 23 represents the region changed thereafter and a 
region 24 represents the region changed after that. The 
region to be compressed at Step S9, after these three times 
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of changes are generated and then the screen remains static 
for a predetermined period of time, is a minimum 
rectangular region entirely including the regions 22, 23, 
and 24 shown in Fig. 4, namely a region 25 in Fig. 4. The 
region 25 includes the entire region compressed using the 
method with high compression ratio at Step S4 . It should 
be noted that the region to be compressed at Step S9 and 
Step SIO might be simply a whole screen 21 shown in Fig. 
4 . 

As described above, when the screen is changed, 
utilizing the compressing" method with high compression 
ratio enables the high-speed processing while large 
distortion is generated.. In addition to that, since only 
the changed region is compressed, the processing speed may 
be further increased. 

That is to say, the large distortion is inherently- 
less noticeable when the screen is changed. In addition, 
the image is compressed using the method with less 
distortion when the screen remains static for a 
predetermined period of time, thereby making it possible 
to achieve the high-quality compression for the static 
image in which the distortion is likely to be noticeable. 

While the JPEG compressing method is illustrated as 
the compressing method with high compression ratio and less 
distortion in the present embodiment, it is not limited 
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thereto. Similarly, the PNG compressing method is 
illustrated as the compressing method with no distortion, 
it is not limited thereto. 

Moreover, while it is described in the present 
embodiment that the image is compressed using the method 
with high compression ratio when the screen is changed arid 
using the method with less or no distortion when the screen 
remains static, it is not limited thereto. It is possible 
to compress the image at different compression ratios 
according to a degree of change in screen. 

Furthermore, while it is described in the present 
embodiment regarding the case that the number of 
recompression times is twice, first by the low-compression 
JPEG method and second by the PNG method, it is not limited 
thereto. For example, the number of recompression times 
may be once, and the first time compressing may be either 
of the low-compression JPEG method or the PNG method, but 
not limited thereto. Moreover, the number of 

recompression times may be set to any arbitrary number of 
times including three times or more. Meanwhile, when the 
number of recompression times is set to twice or more, the 
image to be compressed later should be compressed at the 
lower compression ratio, or at the compression ratio with 
less distortion or using the compressing method with less 
distortion, compared with the image previously 
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compressed. 

Furthermore, it is described in the present 
embodiment that the image in the changed region is 
compressed using the compressing method with high 
compression ratio when the changed region is detected, it 
is not limited thereto. It may be considered that the most 
of the screen is changed when the changed region occupies 
more than a predetermined fraction, for example 85%, and, 
in such a case, the region other than the changed region 
may be compressed as well at the high compression ratio. 
When the changed region is not detected, the whole screen 
may be compressed using the compressing method with less 
or no distortion. 

While it is described in the present embodiment that 
the compression process is not performed when the PC screen 
remains static for a predetermined period of time, for 
example, one second after the compression process is 
performed, a method to count the predetermined number of 
loops instead of the predetermined period of time may be 
applied. Moreover, when different static images composed 
of a drawing and an instruction text are alternatively 
displayed at every five seconds, the image may be 
compressed using the compressing method with low or no 
distortion and outputted upon detecting the PC screen not 
being changed. This is because that, while the static 
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images are displayed alternatively at a predetermined 
interval, even when the imaged is compressed using the 
compressing method with low or no distortion and thereby 
output upon detecting the PC screen not being changed, a 
load may not be applied to the system. 

While it is described with reference to the flowchart 
shown in Fig. 1 according to the present embodiment that 
the compressed image or the like is written in the 
transmission memory at Step S12 , it is not limited thereto . 
At Step 12, instead of writing the compressed image or the 
like in the transmission memory, the compressed image or 
the like may be written in a storage medium, such as a 
magneto-optical disk medium, an optical disk medium, or 
a magnetic disk medium, or written in a memory or the 
storage medium at a remote location via a network or the 
like . 

While it is described that the process branches based 
on whether the predetermined period of time passes at Step 
S7, it is not limited thereto, and any variable time may 
be applied under a predetermined condition. For example, 
while it is described in the present embodiment that the 
region to be compressed at Steps S9 and SIO is the minimum 
rectangular region entirely including the regions 22, 23, 
and 24 shown in Fig. 4, the region may be calculated in 
advance to set a condition based on the size of the region 
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so as to shorten the time until the recompression is 
performed when a region is small and to extend the time 
when a region is large. Thereby, that makes it possible 
to adjust the load applied to the system. 

While it is described in the present embodiment that 
it is determined whether the PC screen is changed based 
on the presence/absence of the changed region at Step S2, 
it is not limited thereto. It may be determined, at Step 
S2, that the PC screen is not changed when the changed 
region is equal to or smaller than a predetermined size, 
and that the PC screen is changed when the changed region 
is larger than the predetermined size. 

Further, while it is configured in the present 
embodiment in such a way that whether the PC screen is 
changed will be determined based on the presence/absence 
of the changed region at Step S2, it may be configured in 
such a way that the change is not detected depending on 
a certain size or position of the changed region. An 
example thereof will be illustrated in Fig. 9. 

Fig. 9 illustrates, as compared with Fig. 1, 
additional steps including Step S64 to determine whether 
a change occurred. Step S70 to determine whether the 
process went through Step S64, Step 55 to store the changed 
region. Step S76 to reset elapsed time, and Step S77 to 
reset the go-through of Step S64 . There will be described 
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an example of the change not being considered as the change 
when the changed region stored at Step S65 having the size 
of 32 pixels in horizontal direction by 32 pixels in 
vertical direction (referred to as 32x32, hereinbelow) is 
in the same position as the current changed region at Step 
S62. The same position herein refers to that the region 
is positioned within the area of, for example, 8x8 pixels 
in horizontal and vertical directions, but not limited 
thereto. For example, calculation of the changed region 
may be performed using an 8-pixel unit to thereby consider 
the regions being in the same position when the sizes of 
the 8-pixel units are identical, but not limited thereto. 

Fig, 10 shows a changing point in the PC screen by 
a mark "x" . In Fig. 10, when the size of the changed region 
61 is equal to or smaller than 32x32 and the position 
thereof is identical to that of the region stored at S65, 
the region is not considered as the changed region at Step 
S64 and the process then proceeds to Step S68. When n=2 
and the predetermined period of time has not been passed, 
it is determined that the recompression is not required 
and the process proceeds to Step S65 via Step S70. It is 
determined that there is no change at Step S64, however, 
in this case, it does not take time for recompression and 
it is actually changed, so that the changed region 61, not 
considered as the changed region, will be compressed at 
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step S66. In this manner, it can follow the change in the 
changed region 61 other than in the case of recompression. 
The process then proceeds to Step S67 and Step S75 to write 
in the transmission memory and returns to Step S61 again. 
While the process starting from Step S61 is repeated, when 
the changed region is larger than 32x32 or there is a change 
in the other position than the stored position, the process 
goes through Step S7 6 to reset the time. When the time 
is not reset and the change only of 32x32 or smaller keeps 
occurring in the same position, the process branches at 
Step S69 to Step S71, where the recompression is performed 
and the distortion in the image is further decreased. The 
region to be recompressed may be the minimum rectangular 
region including the region changed after the compression 
at Step S72 or Step S73 as described above, or may be the 
whole screen 21 shown in Fig. 10. 

If the region where the image is changed is equal to 
or smaller than the a predetermined size in area, and is 
in the same position as the previously detected region 
where the image is changed, determining that the image is 
not changed enables the image to be replaced with the image 
with small distortion by the recompression even when the 
change in a small identical region not requiring high-speed 
change, for example a blinking cursor, is detected. 

As described above, according to the present 
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embodiment, there are provided detection means of 
detecting whether an image to be processed is changed 
exceeding a predetermined criterion; compression means of 
compressing the image so that a compression degree may be 
higher when a detection result by the change detection 
means indicates that the image is changed exceeding the 
predetermined criterion, and when the detection result by 
the change detection means indicates* that the image is 
changed not exceeding the predetermined criterion, of 
compressing the image so that the compression degree may 
become lower; and output means of outputting the compressed 
image, so that the image can be compressed smaller in volume 
at high speed while preventing the image from the 
degradation . 

Moreover, according to the present embodiment, there 
are provided detection means of detecting whether an image 
to be processed is changed exceeding a predetermined 
criterion; compression means of compressing the image so 
that a compression degree of the predetermined rectangular 
region including the changed region may become higher when 
the detected result by the change detection means indicates 
that the image is changed exceeding the predetermined 
criterion, and when the detected result by the change 
detection means indicates that the image is not changed 
exceeding the predetermined criterion, of compressing the 
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image so that a compression degree of a rectangular region 
including all of the rectangular regions among former 
images may become lower than that of the image; and the 
output means of outputting the image of the predetermined 
rectangular region including the changed region when the 
detection result by the change detection means indicates 
that the image is changed exceeding the predetermined 
criterion^ and outputting the image of the rectangular 
region including all of the rectangular region when the 
detection result by the change detection means indicates 
that the image is changed not exceeding the predetermined 
criterion, so that the image can be compressed smaller in 
volume at high speed while preventing the image from the 
degradation. 

It should be noted that the changed region in the 
present embodiment is an example of the predetermined 
rectangular region including the changed region of the 
present invention, while the region 25 shown in Fig- 4 in 
the present embodiment is an example of the rectangular 
region including all of the rectangular regions of the 
image previously detected before the current image of the 
present invention . 

( Second embodiment ) 

An image processing method according to a second 
embodiment of the present invention will be explained. In 
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this embodiment, the images displayed on the screen of the 
personal computer (hereinbelow, referred to as PC) is 
consecutively loaded and compressed. In other words, the 
contents of the whole PC screen are temporarily stored in 
the image memory (frame buffer or GRAM) and the image is 
periodically read therefrom to be compressed in the present 
embodiment. Fig. 6 illustrates the PC screen 

schematically, which shows an example in this embodiment 
to process the image by dividing it into four blocks of 
regions 2 6 to 29. 

Fig. 5 is a flowchart illustrating the image 
processing method according to the second embodiment of 
the present invention. Hereinbelow, the method will be 
explained in detail with reference to Fig. 5. 

At Step S21, the whole screen is captured. At Step 
S22, the image is divided into the blocks. In the example 
shown in Fig. 6, it is divided into the four regions 26 
to 29. At Step S23, the changed region is calculated for 
every divided region . When a mark "x" is the changing point 
in a region 31 shown in Fig. 6, for example, a minimum 
rectangular region 30 will be the changed region. 

When there is the changed region, the number of 
recompression times N is set to 0 at Step S24 and the 
compression is then performed using the high-compression 
JPEG method. At Step S27, the image compressed by the 
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high-compression JPEG method is written in the 
transmission memory. At Step S28, it is determined 
whether the block to be processed is the last block. For 
example, when the process is performed in the order of the 
regions 26, 21 , 28, and 29, it is determined at Step S28 
that the block is the last block after the region 29 is 
processed, and then the process returns to Step S21 to 
capture the whole screen. When the block is not the last 
block, the process returns to Step S23 for processing the 
next block. 

When the changed region is not calculated at Step S23, 
the process branches at Step S24 to Step S29. A elapsed 
time of a predetermined period, for example one second, 
is monitored at Step S2 9 and, when it is determined that 
a predetermined period of time passes after the compression 
at Step S26, the number of recompression times N is then 
searched at Step S30. When N=0, the compression is 
performed using the low-compression JPEG method at Step 
S31. When N=l, it means was compression using the 
low-compression JPEG method is performed for the block, 
so that the process proceeds to Step S28 without performing 
the recompression. As will be understood, it is assumed 
that N holds different values for the respective divided 
regions . 

After the compression using the low-compression JPEG 
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method at Step S31, the number of recompression times N 
is set to 1 at Step S32 and the process then proceeds to 
Step S28, At Step S28, it is determined whether the block 
is the last block as described above. 

As a result, while the screen is changed, utilizing 
the compressing method with high compression ratio enables 
the high-speed processing while large distortion is 
generated. Moreover, since only the changing point is 
compressed, the processing speed may be further increased. 

The large distortion is inherently less noticeable 
when the screen is changed. Furthermore, since the image 
is compressed using the method with less distortion when 
the screen remains static for a predetermined period of 
time, the high-quality compression may be realized for the 
static image in which the distortion is likely to be 
noticeable . 

While the high-compression JPEG method is 
illustrated as the compressing method at Step S2 6 in the 
present embodiment, it is not limited thereto, and the 
other compressing method with high compression ratio may 
be applied. Similarly, the low-compression JPEG method 
is illustrated as the compressing method at Step S31, it 
is not limited thereto, and the PNG method may be applied, 
for example. 

Furthermore, while it is described in the present 
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embodiment regarding the case where the number of 
recompression times is only once using the low-compression 
JPEG method, it is not limited thereto. The recompression 
may be performed twice, first by the low-compression JPEG 
method and second by the PNG method, but not limited thereto . 
Moreover, the number of recompression times may be set to 
any arbitrary number of three times. Meanwhile, when the 
number of recompression times is set to twice or more, the 
image to be compressed later should be compressed at the 
lower compression ratio, at the compression ratio with less 
distortion, or using the compressing method with less 
distortion, compared with the image previously 
compressed. 

Additionally, in the present embodiment, there is 
shown an example where while the elapsed time of the 
predetermined period is monitored at Step S29, if the 
predetermined period has passed and N=0, the blocks are 
compressed respectively using the low-compression JPEG 
method at Step S31, the example may be applied to the whole 
screen. In this regard, a single value of N is given for 
the whole screen instead of the respective divided blocks, 
and it is determined whether there is the changed region 
in the whole screen at Step S24. 

While the method is described to monitor the 
predetermined period of time to pass at Step S29, the method 
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to count the predetermined number of loops may be applied 
and it is not limited thereto. 

While it is described that the screen is divided into 
two in the horizontal direction and two in the vertical 
direction, the screen may be divided into only either of 
the horizontal direction an the vertical direction and it 
is not limited thereto. 

While it is described that the process branches based 
on whether the predetermined period of time passes at Step 
S29, it is not limited thereto, and a variable time may 
be applied under a predetermined condition. For example, 
the region may be calculated in advance to set a condition 
based on the size of the region so as, to shorten the time 
until the recompression is performed when a region is small 
for a smaller region and to extend the time when a region 
is large. 

(Third embodiment) 

Fig. 7 is a block diagram of a display system 
according to a third embodiment of the present invention. 
In Fig. 7, reference numeral 31 represents a projector, 
reference numeral 32 represents a screen of the image from 
the projector to be projected, reference numeral 33 
represents a PC, and reference numeral 34 represents a 
wireless LAN transceiver. In the display system, the 
image displayed on the PC 33 is loaded into the memory. 
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The loaded image is then compressed and transmitted to the 
projector 31 via the wireless LAN transceiver 34. The 
projector 31 receives the compressed image and expands the 
image to be displayed on the screen 32. As a result, the 
image displayed on the screen of the PC 33 may be displayed 
on the screen 32 as well. It would be appreciated that 
the PC 33 is an image signal generating apparatus of 
generating an image signal, and the wireless LAN 
transceiver 34 constitutes a transmitting apparatus of 
transmitting the generated image signal. The projector 
31 constitutes a display device of receiving and displaying 
the transmitted image. 

Fig. 8 is a block diagram illustrating an internal 
specific configuration. In Fig. 8, reference numerals 41 
through 47 represent processing blocks on the PC side, and 
reference numerals 50 through 54 represent processing 
blocks on the projector side. 

The PC 33 is provided with image loading means 41, 
updated region calculating means 42, updating region 
retrieving means 44, time management means 45, compressing 
method selecting means 43, image compression means 47, an 
input device 4 6, image information transmitting means 48, 
and compressed image transmitting means 49. 

The image loading means 41 is means of loading the 
whole screen of the PC 33 into the memory. 
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The updated region calculating means 42 is means of 
comparing the current screen with the previous screen to 
calculate the updated region. 

The updating region retrieving means 4 4 is means of 
retrieving the image of the region to be updated. 

The time management means 4 5 is means of selecting 
the compressing method based on the time when the update 
is executed. 

The compressing method selecting means 43 is means 
of selecting the compressing method based on the 
information from the time management means 45. 

The image compression means 4 7 is means of 
compressing the image in the updating region 44 by means 
of the compressing method selection means 43. 

The input device 4 6 is means of inputting 
instructions given by a keyboard, a mouse, etc. 

The image information transmitting means 4 8 is means 
of transmitting the image information obtained from the 
updated region calculating means 42 or the compressing 
method selecting means 43 to the projector. 

The compressed image transmitting means 4 9 is means 
of transmitting the compressed image to the projector 31. 

As will be understood, the image information 
transmitting means 4 8 and the compressed image 
transmitting means 4 9 are implemented by the wireless LAN 
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transceiver 34 . 

The projector 31 is provided with the image 
information receiving means 50, compressed image 
receiving means 51, image expanding means 52, previous 
screen updating means 53, and display means 54. 

The image receiving means 50 is means of receiving 
the image information. 

The compressed image receiving means 51 is means of 
receiving the compressed image. 

The image expanding means 52 is means of expanding 
the compressed image based on the information from the 
image information receiving means 50. 

The previous screen updating means 53 is means of 
updating the image memory for only the section updated from 
the previous screen based on the image information obtained, 
from the image information receiving means 50. 

The display means 54 is means of displaying the 
information in the image memory. 

In this embodiment, the updated region calculating 
means 42 is the example of the detection means of the 
present invention, the time management means 45, the 
compressing method selecting means 43, the updating region 
retrieving means 44, and the image compression means 47 
are the examples of the compression means of the present 
invention, and the image information transmitting means 
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4 8 and the compressed image transmitting means 4 9 are the 
examples of the output means of the present invention. 
Similarly, in this embodiment, the image expanding means 
52 and the previous screen updating means 53 are examples 
of the expanding means of the present invention, and the 
display means 54 is an example of the output means of the 
present invention . 

The operation of the display system configured as 
shown above will be explained. 

Here, the detailed description regarding the 
sections similar to those of the first and second 
embodiments will be omitted. 

The image of the whole screen is loaded into the 
memory by the image loading means 41 . The image is compared 
with the previous image to calculate the changed region 
using the updated region calculating means 42. The 
changed region is obtained as the minimum rectangular 
region including all of the changing points. When the 
changed region is calculated, the high-compression JPEG 
method is selected by the compressing method selecting 
means 4 3 and the updating region retrieving means • 4 4 
retrieves the region calculated by the updated region 
calculating means 42. The image retrieved by the updating 
region retrieving means 4 4 is compressed using the image 
compression means 47. 
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when the updated region is not calculated by the 
updated region calculating means 42, the low-compression 
JPEG method is selected by the compressing method selecting 
means 4 3 when it is determined that the predetermined 
period of time passes after the previous compression of 
the image by measuring the time using the time management 
means 45. The updating region retrieving means 4 4 then 
retrieves the image data of the whole screen, which is 
compressed by the image compression means 47. However, 
when the input is performed by the input device 4 6 such 
as a keyboard or a mouse, the compression is interrupted, 
and the process restarts from the image loading by the image 
loading means 41. The image information transmitting 
means 4 8 transmits the information regarding the region 
retrieved by the updating region retrieving means 4 4 and 
the compressing method selected by the compressing method 
selecting means 43 to the projector 31. The image 
information transmitting means 4 8 also transmits the 
compressed image to the projector 31. 

In the projector 31, the image information receiving 
means 50 retrieves the image information, and the 
compressed image receiving means 51 retrieves the 
compressed image from the PC 33, where the image is expanded 
by the image expanding means 52 based on the image 
information. The updating means 53 then updates the image 
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data expanded to the image memory position of the projector 
31 corresponding to the coordinates obtained by the image 
information from the image information receiving means 50, 
so that the image memory information of the projector 31 
is displayed by means of the display means 54. According 
to the aforementioned configuration, the image displayed 
on the PC 33 may be projected by the projector 31 as well. 

Incidentally, it is described in the present 
embodiment that the PC is used as the image signal 
generating apparatus, but a PDA may be utilized instead 
and it is not limited thereto. Meanwhile, it is described 
that the wireless LAN is used as the transceiver, but a 
wired LAN may be utilized instead and it is not limited 
thereto. Moreover, while it is described that the 
projector is used as the display device, a plasma display, 
a CRT display, or a liquid crystal display may be utilized 
instead and it is not limited thereto. 

In addition, it is described that the 
high-compression JPEG and low-compression JPEG methods 
are selected as the image compression means 47, but the 
high-compression JPEG method and the PNG method may be 
selected and it is not limited thereto. 

Meanwhile, the updated region calculating means 42 
may apply the method to divide the image loaded by the image 
loading means into the regions to process the regions 
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respectively. In this case, the compressing method 
selecting means 43, the updating region retrieving means 
44, and the image compression means 47 also perform the 
processes for the divided regions respectively. 

As described above, when the image updated region is 
calculated, the image on the PC 31 is changed, so that 
utilizing the compressing method with high compression 
ratio while the screen is changed may allow the high-speed 
processing while the large distortion is generated. 
Moreover, since only changed region is compressed, the 
processing speed may be further increased. 

The large distortion is inherently less noticeable 
when the screen is changed. Since the image is compressed 
using the method with less compression ratio when there 
is no updated region in the image for a predetermined period 
of time, the high-quality compression may be realized for 
the static image in which the distortion is likely to be 
noticeable . 

Incidentally, even in the third embodiment, the 
various modifications described in the first and second 
embodiments may be similarly applied. 

It should be understand that the program according 
to the present invention is a program to cause a computer 
to perform the functions of all or some of the means of 
the aforementioned transmitting apparatus according to 
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the present invention and is a program operable with the 
computer. 

The storage medium according to the present invention 
is a storage medium of storing a program to cause a computer 
to perform the functions of all or some of the means of 
the aforementioned transmitting apparatus according to 
the present invention, wherein the storage medium is 
computer-readable, and the read program executes the 
functions cooperating with computer. 

The aforementioned term "some of the means" of the 
present invention refers to one or some of the means among 
a plurality of means. 

The aforementioned term "the function of the means" 
of the present invention refers to all or some of the 
functions of the means. 

An embodiment of the program according to the present 
invention may be such an embodiment that the program is 
stored in the storage medium readable by the computer and 
cooperates with the computer. 

Another embodiment of the program according to the 
present invention may be such an embodiment that the 
program is transmitted via a transmission medium and read 
by the computer, and cooperates with the computer. 

A data structure of to the present invention includes 
a database, a data format, a data table, a data list, or 
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a data type. 

The storage medium includes such as a ROM, while the 
transmission medium includes a transmission medium such 
as the Internet, light, electric wave, or acoustic wave. 

The aforementioned computer of the present invention 
is not limited to the simple hardware such as the CPU, while 
it may include a firmware or an OS as well as peripheral 
devices . 

It should be noted understood that the configuration 
of the present invention may be implemented by the software 
or by the hardware. 

As a result of the aforementioned description, 
according to the present embodiment, it may be determined 
whether the image to be compressed is a dynamic or static 
picture, so that by selecting the appropriate compressing 
method, it is possible to provide the compressing method 
of realizing the high-speed respondibility and the high 
quality in image together. 
Industrial Applicability 

As can be apparent from the foregoing description, 
the present invention can provide the transmitting 
apparatus, the image processing system, the image 
processing method, the program, and the storage medium of 
compressing the image smaller in volume at high speed while 
preventing the degradation of the image. 
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